Images 
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images: what are they? how are they obtained? 
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what is shown in this image 
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what is na image 



images describe the evolution of physical variables (intensity, color, reflectance, 
condutivity) in a plane or in a 3D volume. 
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coordinate systems 
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discrete images 



Most electronic sensors produce discrete images defined on a grid of points 
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pixel - picture element 
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each pixel is characterized by its 
position and value 



Matriz notation 



A discrete image is a matrix. 



Na image l(x) woth M lines and N columns can be represented by a matrix of 
dimension MxN or by a vector of dimension MNx1 . 



Exemplo 
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p.ex., column concatenation 



vector space of images 



sum 

The sum of two discrete images u,v with M lines and N columns is a discrete 
image w such that 

w(x)=u(x)+v(x) 
multiplication by a scalar 

The multiplication of na image u with M linhes and N columnsby a constant a is 
a discrete image w, such that 

w(x)=cc u(x) 

The set of images with M lines and N columns is a vector space. 
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mixing two images 



w(x)= a u(x) + (3 v(x) 




2 images are not enough to synthesize a wide variety of images. 
How many do we need? (discussion) 
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exercises 



1) 
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2) Define a base for the set of 3x2 discrete images. 
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multi-dimensional images 



Asatelite image consists of B real images obtained at 
different frequency bands. 




The value of the image I at a position 
(m,n) is a vector 

l{m,n,0) 



l(m,n) = 



l(m,n,l) 



l(m,n,B-l) 



B imagens 



Another example is the color images. 
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m,n - spatial coordinates 

B - number of frequency bands 



binary images 
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topological concepts 



what is the neighborhood of a pixel (i,j) ? 

I neighborhood 4 

|_J v 4 (i, j) = {(/ - 1, Mi + 1, j - j + 1)} 



neighborhood 8 

v 8 (i, j) = {(/- 1, j - 1), (/' - 1, ;),( / - 1, y + y - 1), 

(/, j + 1),(/ + 1,y-1),(/ + 1, ;),(/ + 1,y + 1)} 
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conectivity 
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are x, y connected? 
NO 



binary image 



conectivity: two pixels x, y of a binary image are connected iif (if and only if) 
there a sequence of points z 7 , z 2 , z": 



1 n 

z = x, z = y 

z , z /+1 are neighbors V/ e n - 1 } 



u(z') = 1 Vi = 1 n 
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regions 




regions 



Region R is a set of fully connected pixels i.e., 

Vx,yeR, x,y are connected 

A maximal set of connected pixels is called a connected component. 
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Algorithm for connected components 



The algorithm assigns different labels to pixels belonging to different connected 
components 



ssign the label of the previous 
neighbors if they are equal 



If the neighbors have different 
labels create na equivalence ^ ^ 
table 
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Boundary 



The boundary of a region R is the set of R pixels whose neighborhood 
is not contained in R. 
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summary: image types 



Image I : D C 

Domain D 

R 2 or interval [a,b]x[c,d] c R 2 continuous image 

Z 2 or interval {0,...,M-1}x{0,...,N-1} c Z 2 discrete image 

Codomain C 

R monocromatic image ex: intensity image 

R n multidimensional image ex: color image 

{0,1} binary image ex: binary segmentation 

{0, L-1} label image ex: segmentagao multi-objectos 
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cor 
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desafio 




o que e a cor ? como e que se indexa uma imagem atraves da cor ? 
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espectro visivel 
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o que e a cor? 



A cor e uma percepgao humana. 

E a resposta dos sensores localizados na retina ao espectro electromagnetico 
na gama 380-750 nm. 




percepgao de cor 



X 



e preciso uma descrigao detalhada do espectro para caracterizar a cor? Nao! 
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teoria tricromatica 



Desenvolvida por Tomas Young (sec. XVIII) Helmoltz (sec. XIX) 



Helmoltz mostrou que qualquer (?) cor se pode sintetizar atraves da mistura de tres 
cores primarias fixas 



expenencia 




mistura 



cor de teste 




S(A) = c 1 P 1 (A) + c 2 P 2 (A) + c 3 P 3 (A) 

pouco intuitivo, com 3 cores primarias nao se pode 
aproximar bem o espectro S{1)\ 



Young acreditava que havia 3 estruturas 
sensiveis a cor na retina. 

verdade?.. 



jorge s. marques, 2009 



retina 



Tal como Young previu, ha tres tipos de 
celulas foto sensiveis na retina designados 
por cones. 

Os tres tipos de cones tern curvas de 
sensibilidade espectral (absorgao) 
diferentes. 
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Dois espectros podem ser diferentes e 

causar a mesma percepgao de cor. meromorfismo 
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Resposta do cone i a urn espectro S(A,) 
R,(S) = I S(A)Si(A)dA 



A percepgao de cor e identica se as respostas dos cones forem iguais. 
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ajuste de cor 



A mistura de cores primarias tem a mesma cor que o espectro incidente se 

R i (S) = R i (S), i = 1,2,3 

S S(A)Si(A)dA = l i c k P k (A)Sj(A)dA i = 1,2,3 

k=l 



Rij=l Pj(A)Sj(A)dA 
/)=/ S(A)Si(A)dA 



a projecgao S(X) c e linear e fica completamente caracterizada se soubermos como 
se transforma cada risca espectral d(k-X 0 ). 
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fungoes de ajuste espectral 



As cores monocromaticas 5(^-X 0 ) podem ser sintetizadas atraves da mistura de tres 
cores primarias. 

M (A) = f x {X) + f 2 Oo)P 2 (X) + h (A) )Pi 0*) 
As fungoes /; (^Jdesignam-se por fungoes de ajuste espectral. 

Os pesos da mistura M, podem ser obtidos a partir das fungoes de ajuste espectral. 

Ci =jfi(A)S(A)dA 

S- espectro da radiagao luminosa 
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CIE 1931 



Guild and Wright fizeram experiencias de ajuste de cores monocromaticas usando 3 cores 
primarias R,G,B monocromaticas. 



Cores primarias monocromaticas 

A x =700w77(red) 
A 2 = 546. lnm (green) 
A 3 = 435. 8/7A77 (blue) 
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Que quantidade de cada cor primaria e necessario misturar para gerar a cor dum 
espectro monocromatico com comprimento de onda ^ 0 fungoes de ajuste espectral 



Este estudo esteve na base da norma CIE de 1931 
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Espago RGB 



CIE, 1931 - sistema espectral primario PjW = 5(A - Aj) 

\ = 700/7/77 (R) A 2 = 546. \nm (G) A 3 = 435.8nm (B) 



fungoes de ajuste espectral diagrama de cromaticidade 
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espago XYZ 
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Os coeficientes sao sempre positivos mas as cores primarias sao irrealizaveis ! 
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diagrama de cromaticidade CIE 1931 
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Componentes de cor 
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Colorimetria 



Como medir diferengas entre cores ? 

Os espagos anteriores nao sao uniformes do ponto de vista perceptual: a diferenga 
perceptual entre duas cores nao e proporcional a distancia euclidiana entre as 
respectivas coordenadas de cor. 
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pianos de cor 




Metricas de cor 



espagos de Riemann 

2 33 

(ds) = 2 Z cijdXidX j os coeficientes variam ao longo do espago 

''=1.7=1 



coordenadas nao lineares 

aplicar uma transformagao nao linear as coordenadas de cor mantendo 
a distancia euclidiana. 
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Espago LAB 



CIE 1976 - coordenadas nao lineares 
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L* - brilho 

a* - conteudo vermelho-verde 

b* - conteudo amarelo-azul 

X 0 , Y 0 , Z 0 - coordenadas do branco de referenda 



Sao apropriadas para colorimetria: medigao de diferengas de cor 
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espago HSI 
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Formulas de conversao 



/ = ^(R + G + B) 



Gonzalez & Woods 



s=i- 



3min(R,G,B) 
R+G+B 



^ cos ' 
271 



( 



0.5 (R-G+R-B) 



H = < 



^(R-Gr+(R-B)(G-B)J 



1-J-cos 1 



( 



0.5 (R-G+R-B) 



B>G 



B<G 



^(R-Gr+(R-B)(G-B)J 



B = \(\-S), R = \{\+ S cos0 ],G = l-(B + R), 6 = cos(27iH), 0 < H < \ 
3 3 cos( 0-| ) 3 

R=\(l-S), G=kl+ Scos0 ], B = l-(R+G), d=cos(27r(H-\)\ \<H<\ 

3 3 cos( (9-| ) 

G =\(\-S), B = \[\+ Scos0 ], R = 1-(G + B), 9 = cos(2/r(H - f)), \<H <1 
3 3 cos( (9-| ) 3 3 
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como descrever o conteudo de cor de urna imagem ? 
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where is wally? 
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ou um problema mais realista 




estudantes de piv bem dispostos! 
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exemplo: camisola 




exemplo: pele 
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exemplo - pele 
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Histograma de cor 




contar o numero de pixels que 
pertence (vota) em cada celula. 



h k - numero de pixels da celula k 



A informagao espacial e destruida no calculo do histograma. 
O espago RGB e muito usado mas ou outros espagos podem tambem ser usados. 
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interpretagao probabilistica 



Pode-se assumir-se que os pixels da imagem sao realizagoes de uma 
variavel aleatoria discreta com distribuigao 



P(k) = C h k C - constante de normalizagao 



A comparagao entre imagens passa a ser uma comparagao entre 
distribuigoes de probabilidade. 
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comparagao de histogramas 



norma euclidiana Z [P\(k) - P 2 (k)\ 

k 



distancia do mmimo Z min{P 1 (^),P 2 (^)} 

k 



divergencia de Kullback £ Pi(k)\og^S£± 
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